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ABSTRACT 


The NEPHAT (Northeastern Pacific Hurricane Analog 
Tracker) Forecast Program is developed and introduced. 
NEPHAT selects analog tropical cyclones from 25-year 
Northeastern Pacific Ocean history. Each selected analog 
track is statistically adjusted for known differences 
between it and the recent history of the tropical cyclone 
being forecasted. The adjusted analog cyclone trajectories 
are then composited into a single forecast track. Verifi- 
cation results are shown for randomly selected historical 
cases, with a Monte Carlo simulation of initial operational 
position inaccuracies. Intercomparisons of ipeoe asiee made 
by NEPHAT and other objective and subjective forecast 


schemes are presented. 
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I. INTRODUCTION 


Tropical cyclone forecasting (development, movement, 
intensity) is an important and time-consuming task for the 
Navy meteorologist. Objective guidance is necessary for 
credible results. Such guidance exists in great abundance 
for the North Atlantic Ocean (Neumann & Hope, 1973) as well 
as the western North Pacific Ocean (WESTPAC) areas (Fleet 
Weather Central/Joint Typhoon Warning Center, 1973). Rela- 
tively few objective techniques are available for the 
eastern tropical North Pacific Ocean (EASTROPAC) area, 
reputed Be be the region of greatest tropical cyclone 
density (Hansen, 1972). This study treats the forecast 
problem of tropical cyclone motion in EASTROPAC, encompass- 
ing the area from 180 degrees to the North American Coast, 
and north of the Equator to usually less than 30 degrees 
North. 

Interest in the tropical cyclones of this area was 
spurred by the introduction of weather satellites in 1964. 
It became apparent that there existed a far greater fre- 
quency of tropical cyclones in EASTROPAC than had previously 
supposed. (See Table I.) Further, the EASTROPAC cyclone 
area lies athwart major shipping routes between the Panama 
Canal and the Far East in addition to coastwise routes 
between North and South America. In addition to oceanic 


shipping, this area is a major fishing ground of the west 





coast commerical fishing industry. Freeman (1972) tabu- 
lated 585 Navy or Navy-contract vessels which made 
EASTROPAC transits during 1970. The past few years have 
also seen a great increase in the number of United States 
registered small, pleasure craft. These are particularly 
vulnerable to tropical systems and would derive a great 
benefit from improved forecasts. 

When one considers the relatively slow speed of sea- 
surface transportation, the need for a fairly reliable 
movement forecast, extended to 48 and 72 hours, becomes 
obvious. The current modes of forecast used in EASTROPAC 
are the subjectively derived official forecasts issued by 
the National Weather Service Forecast Office in Redwood 
City, California, and the Navy's MOHATT Program (Renard, 
et al, 1973) run operationally by Fleet Numerical Weather 
Central, Monterey, California. 

Starting in 1969, objective techniques were developed 
that used an analog concept. Designed for WESTPAC and 
called TYFOON, one such technique was formulated at the 
National Weather Records Center (Hodge and McKay, 1970) 
and subsequently modified by Jarrell and Somervell (1970) 
at the Navy Weather Research Facility, Norfolk, Virginia, 
and by Jarrell and Wagoner (1973) at the Fleet Weather 
Central/Joint Typhoon Warning Center, Guam. Concurrently, 
a similar technique, called HURRAN, was designed by Hope 
and Neumann (1970) at the National Hurricane Center in 


Miami, Florida, for the prediction of the movement of North 
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Atlantic tropical cyclones. Both techniques are designed 
to identify past storms containing characteristics similar 
to the cyclone being forecasted. When the movements of 
all similar past cyclones are assembled, their average 
movement Pec eieed and the locations on the average 
analog track are used as guidance in the issuance of fore- 
CaSES.. 

Wagoner (1973) observes that a large portion of the 
forecaster's subjective prognosis is nothing more than an 
analog procedure. He simply searches his mind for situa- 
tions similar to the one presently confronting him. These 
are then converted into a modified forecast by mentally 
determining the average outcome of all the situations. 

The similarity between the mental processes and the analog 
technique probably explains why the accuracies of the two 
approaches are comparable. 

This study describes the development of an analog 
technique to forecast the movement of EASTROPAC cyclones 
to 96 hours. A flow diagram of the step-wise forecast 


procedure is contained in Figure l. 
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II. CLIMATOLOGY AND DATA 


A. CLIMATOLOGY 
In general, the EASTROPAC cyclones are formed in the 
eastern section of the area and propagate northward and 
westward (Figure 2). In the subject area the season ex- 
tends from mid-May through October with less than one 
percent of the tropical cyclones forming out of season. 
An annual average of 14.5 tropical storms form, of which 
5.4 become hurricanes, according to a climatology of 
tropical cyclones in this area, compiled by Hansen (1972). 
Other pertinent facts from this reference follow. The mean 
track is toward 292 degrees though this varies with lati- 
tude. The mean speed of EASTROPAC cyclones is 10.3 knots 
with a standard deviation of 3.0 knots. The relative 
incidence of recurvature is significantly less than the 
North Atlantic and WESTPAC areas and the most likely time 
of recurvature is near the end of the season. EASTROPAC 
cyclones range in size from 1.5 to 5.5 degrees of latitude 
(mean circular cloud Alemany Their mean area is about 


half the mean area of WESTPAC tropical cyclones. 


B. DATA 
Historical data were compiled by the National Climatic 
Center, Asheville, North Carolina (NCC) and consist of the 


initial position plus best track 0000 and 1200 GMT positions 
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for all known tropical cyclones from 1949 through 1973. 
These data, available on computer punch cards, consist of 
one position per card, the entire set comprising 2,942 
different positions. Because this volume of cards was 
unwieldy, the data set was compressed to 708 cards. Con- 
currently with this change of data format all the off-time 
(non~0000 or ~1200 GMT) positions were removed from the 
history file. In addition, all cyclones which contained 
less than three positions (after off~time positions were 
removed) were also eliminated from the file. This has no 
effect on forecasts as three positions are necessary to 
make a 24-hour forecast (the minimum forecast interval 
made in this program). 

The next step in the data evaluation involved removal 
or modification of any positions of tropical cyclones 
thought to be inaccurate. In the latter category, two 
cyclones were completely eliminated from the history file. 
One of these appeared as a March (1951) system located in 
the middle North Pacific Ocean area and contained a large 
easterly component of motion. The other was a 1955 hurri-~ 
cane which formed and remained in the North Atlantic area. 
In the former category, those positions displaying a much 
larger than normal 12~hour north-south movement (in excess 
of five degrees latitude) were investigated. One case (a 
seven-degree movement in the final 12 hours of the storm) 


was deemed to include a five-degree error and adjusted 
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accordingly. The net result was a history file covering 
25 years and consisting of 257 tropical cyclones with 2666 
positions. 

Because of the obvious difference in data volume before 
and after the advent of meteorological satellites (131 
storms with 1,043 positions for the 16 years prior to 1965 
compared with 126 tropical cyclones and 1,623 positions 
for the nine years 1965 through 1973), the issues arose 
as to whether there existed other significant differences 
in the data. For example, there might be a lack of 
character in the tracks of early cyclones as compared to 
the post-satellite era, due to a relative paucity of in- 
formation. If this were indeed true and statistically 
Sienificant, then the ferecast scheme could be adversely 
affected; that is, early tracks might have to be disregarded 
as possible analogs to future tropical cyclones. 

To resolve the issue, a Smoothness check was run on 
the data. The check consisted of calculating the distance 
from the second point of each set of three consecutive 
points (at 12-hour intervals) to the midpoint between the 
‘first and third points. (See Figure 3.) In addition to 
giving an indication of the eccentricity (deviation from 
the linear) of the tracks, this procedure gave a measure 
of curvature. The magnitudes of the vectors labeled R 
(across track deviation), S (along track deviation), and 


E (total deviation, R + S) summed and averaged by year and 
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by period for the time frames in question. For the period 
from 1949 through 1964, for 781 cases the average magnitude 
of E (= E) was 20.8 nmi (variance = 362.4 ve This was 
composed of a mean across-track displacement,? R, of -1.9 
nmi (variance = 412.5 amy and a mean along track displace- 
nea S, of -0.3 nmi (variance = 377.7 Pica) Eons the 
period 1965 through 1973, for 1,371 cases, E was 20.0 nmi 
G@aarrance = 251.5 Toe R was -1.6 nmi (Vvardance.s=—255c: 
a) and § was 0.6 nmi (variance = 392.5 ae 

The results obviously negated the original hypothesis 
that the earlier tracks were smoother. In fact, it seemed 
to imply that the earlier tracks were significantly more 
eccentric than the post-satellite period tracks. The data 
set was again checked and those individual points contri- 
buting the most to the variance were checked. The majority 
of these fell inte a category involving recurvature which 
would result ina large across-track displacement. To fur- 
ther investigate the eccentricity of the two periods, the 
across-track, along-track and mean total displacements were 
again computed, then normalized by dividing the displace- 
ments by one half the total 24-hour movement magnitude 
(lV]). (See Figure 3.) These results were again totaled 
and averaged by year and period. (The results are contained 


in Tables II and III.) Once again there seemed to be a 


mee eiy.e numbers indicate anticyclonic curvature of 
the track. 


aaeaeive numbers indicate deceleration along the track. 
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Significant difference in the variance of eccentricity be- 
tween the two periods. Again, the early period appears 
to be significantly more eccentric than the post-satellite 
years (early period variance = 0.116 vs later period vari- 
ance = 0.048). As before, the points making the greatest 
contribution were individually inspected and there were 
very few points that made a large contribution to the 
variance of both the original and the normalized set of 
data. Those points making the largest contributions pri- 
marily to the normalized set were cases in which there was 
very little 24-hour movement but a relatively large dis- 
placement of the middle point (B) from AC (in Figure 3) 
such as in a cyclone that had in reality looped but was 
held in the best-track data as relatively stationary. 
Because no real conclusions were drawn as to the true 
significance of the possibly greater eccentricity of the 
earlier tracks or the effect on the forecasts, the option 
to drop the data from 1949 through 1964 was held open 
throughout the development of the forecast technique. 


The problem was only resolved in the final test and evalua- 


tion. (See Chapter IV.) 
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Itl. TEST CASES 


Some form of test cases or test positions is required 
at all phases during the forecast technique development 
cycle (Figure 4). Ideally it is preferred to have one set 
of cases with which to perform any routine testing during 
development and an entirely independent set of cases for 
testing the final forecast technique. This independence 
would improve the probability of detecting forecast insta- 
bility during testing. Hence, there would be anaes 
probability that the forecast technique would perform in 
the same manner in an operational environment as in the 
controlled Meco conme ker 

To accomplish this statistical independence entails 
the use of a large sample of test cases (a few hundred), 
none of which could use as analogs those cyclones which 
contain any of the test cases. However, the limited size 
of the present data set for EASTROPAC makes this unrealistic 
(257 named cyclones with 2,666 positions). To circumvent 
this problem, two different sets of test data were used. 
For the final verification of the technique, use was made 
of an existing set of 1973 operational positions, from 
which official and MOHATT (Renard et al, 1973) forecasts 
had been made. This set presented an opportunity to com- 


pare the verifications of the analog technique with an 
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operationally used objective technique as well as subjec- 
tive official forecasts. 

However, prior to making these operational-type fore- 
casts a set of easily accessed, changeable and readily 4 
verified test positions were needed. Because several modi- 
fications would be attempted, the identical positions would 
need to be recalled and the results from each of the modifi- 
cations compared with the previous attempts. 

A test-position generator was incorporated as a 
removable component in the forecast program, The key to the 
selection of the test position is a random number which is 
generated internally. The test candidates are contained 
within the history file. After a candidate for a test 
position is screened to insure at least the required amount 
of history and verifying positions (for example, in a 72- 
hour forecast at least six successive positions are required 
for verification), the random number subroutine generates 
a number between zero and 100. This is compared with a 
specified number (adjustable due to computer turn-around 
time limitations) corresponding to the percentage of cases 
(out of possible 2,152) desired, and if the generated number 
is less than this number, then, this position is "selected" 
as a test case. 

After a test case had been selected, the 12- and 24- 
hour history positions (if required) were retrieved from 


the file. Next, the initial and 12-hour history positions 
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were contaminated to simulate an operational error using 
a subroutine in the program which computed a 24-hour 
error by a “Monte Carlo" technique (Hillier and Leibermann, 
1967) applied to the cumulative frequency distribution 
(Figure 5) of 24-hour typhoon forecast errors in WESTPAC 
(FWC/JTWC, 1971). Depending upon the simulated time inter- 
val since the last fix, a predetermined portion of the 
simulated 24-hour error was added (as a two-component 
vector) to the initial position and one-half that initial 
position error was added to the 12-hour history position. 

In WESTPAC the distribution of warning-position errors 
is very well described by using that percentage of the 24- 
hour forecast error which is dependent on the fractional 
part or the 24-hour period eiapsed since the last fix. 
(See Figure 5.) WESTPAC warnings are based on reconnais- 
sance fixes which are almost always within the past six 
hours, with the maximum frequency at scheduled fix times 
(i.e., two hours before warning time), and an average esti- 
mated to be about an hour earlier than scheduled fix time. 

Four classes of positions, dependent on the time inter- 
val since the last reconnaissance or a good satellite fix, 
was considered. (A good satellite fix is one in which the 
words good or excellent are used in the subsequent warning 
message to describe the position accuracy.) 

Since, as stated above, the WESTPAC fix time is, on 


the average,about three hours prior to warning time (i.e., 


18 





time from which forecast interval is counted) the 24-hour 
forecast is in reality a 27-hour forecast. 

Error magnitudes were given by entering Figure 5 (for 
24 hours) with a random number (between zero and 100). 
After the proper portion of the selected magnitude had been 
taken, depending on time since the last fix, a second 
random number distributed the error into equally likely 
positive zonal and meridional components. A third random 
number determined the quadrants,relative to the cyclone 


center,containing the error vector. 
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IV. FORECAST TECHNIQUE DEVELOPMENT 


A. INTRODUCTION 

The assumption is made that a pure analog forecast 
scheme will not perform satisfactorily. A pure analog 
scheme is defined as one where history is searched for a 
Situation analogous to an existing situation. Such an 
analog is found and the subsequent behavior of this analog 
is used directly as a forecast of the future of the exist- 
ing Situation. Pure analog schemes, for tropical cyclone 
forecasting, have failed for two reasons. First, good 
analog pairs (those whose future are closely parallel) 
are not common enough to presuppose a single good analog 
could be found for most forecast situations. Secondly, 
there are no known methods for reliably discriminating 
poor analogs from ordinary analogs or ordinary analogs 
from good analogs. Hence, there exists no method to 
select a superior analog if one exists. 

One way around the dilemma is to use some sort of screen- 
ing to separate the ane One into groups, ranging from the 
best to the worst. Ina statistical sense this is possible; 
that is, one can Ber eee the analogs into groups which are 
better (or worse) than average performers. Generally, 
analog schemes have tried to separate analogs into two 


groups: "good enough" and "not good enough", The "not good 
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enough" group are then ignored and the "good enough" group 
forms the basis of the forecast. Usually these are con- 
posited into a single analog forecast using an ordinary 

or weighted average after each has been adjusted for any 
systematic (and predictable) differences between it and 
the cyclone being forecast. 

The variations between analog schemes fall into three 
areas: (a) how is "good enough" determined or what sort of 
screening or filtering should be used to eliminate un- 
acceptable analogs, (b) how to correct or adjust for dis- 
cernable differences between the existing cyclone and an 
analog cyclone, and (c) how to composite the group of 


adjusted "good enough" analog tracks. 


B. DETERMINING ACCEPTABLE ANALOG 

How good is "good enough?" If each analog track is 
viewed as an independent, unbiased estimate of the track 
to be forecast, then the central limit theorem suggests 
that as one makes more estimates, the average of these esti- 
mates should converge toward the true value being estimated. 
While independence is by no means assured (in fact 
dependence is the basis of analog forecasting), the widely 
accepted preference of a composited over a single analog 
track is in itself endorsement of the concept of improve- 
ment in forecasts as the number of analogs in the composite 


increases. Since the period of retrievable history is 
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severely limited (especially in EASTROPAC), there is an 
upper limit on the possible number of analogs. Within 
this limit, the number of analogs actually used depends 
upon the definition of "good enough." As we relax our 


' we increase the number of ana- 


criteria for "good enough,’ 
logs, but we draw more from a population of not-so-good 
analogs. Obviously, we would like to define the "good 
enough" cut-off point as that point where the improvement 
brought about by increasing the number of analogs exactly 
balances the detrimental effect of including worse analogs 
and beyond which the net effect is to decrease the 

accuracy of forecasting the cyclone track, 

A measure of goodness. When two tropical cyclone tracks 
are compared, it is desirable to have some measure of 
Similarity between them. There are certain differences 
between any two cyclones at the point of origin (of the 
forecast) that may help explain future differences. If so, 
these explanable future differences should be removed before 
a yardstick of similarity is applied. The method adopted 
here to accomplish this involved running least-squares 
regression to predict that portion of the track difference 
between two tropical cyclones after 48 hours which was not 
present at the eGnmon Starting points (starting points are 
randomly chosen along the two tracks). A list of predictors 
are found in Appendix A. The unexplained variance (sum of 
meridional and zonal components) is then a measure of the 


dissimilarity between each pair of cyclone tracks. 
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As a point of departure, a set of five symmetric 
screens was established, patterned after Jarrell and Somer- 
vell (1970). The screens are: 

l. Latitude difference between two origin points (TY) 


2. Longitude difference between two origin points 
(TX) 


3. Relative meridional movement between two cyclones 
over the prior 12 hours (BY) 


4. Relative zonal movement between two cyclones over 
the prior 12 hours (BX) 


5. Difference in Julian dates of origin points (DD) 
Several hundred different combinations of symmetric 
cut-off values for these screens were subjected to regres- 
Sion analysis. Recorded for each such test was the a 

explained variance and number of cyclone pairs passing 
through all five screens. 

Only the 1965-73 history file was used in this effort. 
This limited the history to 126 tropical cyclones and 1,623 
positions. Once the first of the pair of points was 
selected, all the other 1,622 points (except those of the 
cyclone which contained the first point) were eligible to 
play the role of the second of the pair of points. The 
maximum possible number OE pairs was in excess of one mil- 
lion. By use of a random selection, the number of pairs 
was restricted to a ee percent of the total possible 
(usually 10,000 to 50,000). 

From these hundreds of runs there were constructed 


rough curves of the rate of change of unexplained variance 
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with a unit change in a particular screen setting and also 
the change in the rate of acceptance (number of pairs pass- 
ing a screen divided by the number of pairs subjected to 
screening) with a unit change in screen setting. Both 
measures represent approximations to partial derivatives 
since all other screens were held constant at various 
values over their possible range. By a process of succes- 
sive approximations those optimum (minimum total unexplained 
variance) screen settings were determined which permitted a 
given percentage of the matched pairs to pass. Optimum 
screen settings were determined for acceptance rates of 
five to 50 percent in increments of five percent. These 
screen settings are given in Table IV. A sample of 371 
48-hour test forecasts were made at each acceptance level 
up to 30 percent. Mean error, root mean Square (RMS) error, 
number of cases, and failure rate are also given in Table 
IV for each of these acceptance settings. (A failure here 
was defined as a case where two or less analog cyclones 
were usable. This was considered an invalid forecast. 

This cut-off was later changed from two to ten.) Notice 
that the minimum average and RMS errors occur near an 
acceptance rate setting of 15 percent. This suggests that 
the set of screen settings corresponding to 15 percent is 
near the point of optimum trade-off between the advantage 
of more analogs and the disadvantage or accepting more 


“"not-so-good" analogs. 
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When considering adoption of 15 percent settings another 
facet of the problem appeared. The failure rate of over 
nine percent is high. For a forecaster to get a "sorry 
about that" message nine percent of the time leaves some- 
thing to be desired. It was arbitrarily decided that a 
failure rate greater than five percent was unacceptable if 
it were possible to bring the failure rate to below that 
level without appreciable loss of forecast accuracy. 

With this thought in mind, the screen settings selected 
were those corresponding to the 30 percent (acceptance) 
settings. The 30 percent settings possessed a failure rate 
of around two percent. While this would appear to be 
setting standards too low, these forecasts were based on 
best-track data with ne initial pesiticn error and with 
only two analog cyclones required for acceptance. With 
the addition of an initial-position error and a change to 
at least ten analog cyclones for acceptance, the failure 
rate at 48 hours for even the 30 percent Settings signi- 
ficantly increased. 

C. ADJUSTING ANALOG FOR BEST COMPARISON TO EXISTING 

CYCLONE 

Once the screens are set, the question arises as to how 
one adjusts the analog track to remove the discernable 
difference between the analog and current tropical cyclones. 

The obvious first difference is that of position. 


(Note that this is the basis of the first two screens.) 
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To account for this difference all the points (past, pres- 
ent, and future) on the analog track are "translated" or 
adjusted (Figure 6) by the amount of the vector from the 
analog origin position to the origin of the current cyclone 
(TX and TY, as defined earlier). After this adjustment has 
been made, the next obvious difference in the tracks was 

the past movement. (Recall that past 12-hour motion differ- 
ences are screen parameters.) In addition to the oie 
past movement differences (12-hour bias), the 24-hour past 
movement differences were also calculated. 

There were several ways that an adjustment might have 
been made to the recy track. TYFOON-72 (Jarrell and 
Wagoner, 1973) vectorily added in the equivalent of the 
i2-hour bias at each l2-heur forecast interval (i-e., the 
48-hour bias is four times the 12-hour bias; see Figure 7) 
while in the Atlantic HURRAN (Hope and Neumann, 1970) 
applied the 12-hour bias at a decreasing rate with Pores 
cast interval (ranging from the entire amount of bias for 
a 12-hour forecast to a maximum at 36 hours and beyond). 

In EASTROPAC it was decided to use regression equations 
to determine the best bias adjustment. In order to accom- 
plish this task, the program for the aforementioned regres- 
sion analysis and the forecast program were combined and 
a new set of regression equations for the bias were 
written. Equations were written using a random sample 


of around 500 cases. A different set of equations for the 
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latitude and longitude components of bias was written de- 
pending upon the time since the last fix (simulated to be 
3, 9, 15, or 21 hours), the amount of history given (zero, 
12, or 24 hours) and each forecast interval (24, 48, 72, 
or 96 hours). In total, 96 different equations were 
developed. Fifty variables were available for entry into 
the regression equation. However, only the most signifi- 
cant ones were used; those which, upon entering, explained 
less than an additional 1 percent of the total variances 


were not used. 


D. COMPOSITING ANALOGS IN THE FORECAST 

When the history file is exhausted and all analogs have 
been screened and those considered "good enough" have been 
adjusted for position and movement, the problem of finding 
some method of compositing the storms into a single fore- 
cast remains. Once again there are different methods by 
which this might be accomplished. One might composite with 
a simple average or by some weight attached to each analog 
forecast. 

It was decided to use this latter method in EASTROPAC 
in view of the liberal screens used in order to insure 
making a reasonable amount of forecasts. By down-weighting 
those factors far removed from the mid-point of the 
acceptance region it was felt the average error might be 
brought more in line with the 15 percent case. To accom- 


plish the compositing, two types of weighting factors were 
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multiplied to form a single weight. The first factor re- 
flected the statistical fact that analogs with a screen 
parameter far removed from that of the current cyclone is 
more likely to produce a poor forecast than one closer. 
The second factor reflected the supposed lesser accuracy 
of analogs which have no past history (or only 12-hour 
Wiswmory). 

Several parameters were tried in an effort to establish 
the first weight factor and all involved some measure of 
the probability of a good 48-hour forecast (error less than 
180 nmi) and the probability of a bad forecast (error 
greater than 240 nmi). On atest sample of 363 cases the 


best weighting factor was 


2 G1. 4 
w= QW (op (1) 
j=1 ‘ Bi, J 
where Prat 4 Saas is the probability of a good (bad) 


forecast given that the ijth class has occurred. The j 
reflects the five different screens and i reflects that 
each screen interval is divided into five regions. This 
weighting factor had little influence on the total RMS 
error, except for those cases with a small number of analog 
storms (less than 20). The apparent influence on these 
cases was to make their error distribution fall in line 


with that of cases using large number of analogs. 
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The second weighting factor reflected the fact that 
better forecasts resulted from a longer history (a manifes- 
tation of a persistence contribution). Weighting factors 
(meridional and zonal components) consisted of the recipro- 
cal of the variance of error Cis). There was no statis- 
tical difference in the variance of the latitude component 
of error (perhaps due to small acceptable range of 
meridional motion) but zonal variances were markedly dif- 
ferent for 12-hour history compared to no history but 
somewhat less different for 24-hour history versus 12-hour 
history. Any difference diminished as initial-position 
error increased (since indicated past motion became a less 
reliable index of future motion). Thus, these weighting 
factcrs were really important only when a good history was 
available. Additionally, history was most important in a 
24-hour forecast and least important at 96 hours. Note 
that if no history was available for the current storn, 
history on an analog storm was immaterial therefore the 
weighting factor was only used when the current cyclone 
history equaled or exceeded the analog history. 

E. MODIFICATIONS TO ANALOG PROGRAM FROM DEVELOPMENT 

TEST RUNS 

At this point the technique was run ona set of 551 
simulated test cases. A record was kept (see Table V) of 
the average error, RMS error and number of forecasts 


verified at each forecast interval, using varying amounts 


30 





of history and simulated initial ee errors.eeorhben 
proposed modifications (largely simplifications) were 
tested (one at a time) and the results compared with the 
above. In the end four site’ Pies modifications were 
made to the program. (A trial modification was retained 
if either there was no significant increase in the errors 
or no significant decrease in the number of forecasts 
verified.) 

The first modification was that each individual analog 
position was considered independently. Prior to this all 
the forecasts from the positions on a single analog cy- 
clone were weighted and averaged. Then all these average 
positions from the analog cyclones were composited for 
the final forecast positions. However, the requirement 
that a valid forecast must have a contribution from at 
least ten difference cyclones was retained. 

The second modification involved testing the signifi- 
cance of the regression equations. All the regression 
equations for the latitude bias correction were found to 
give no appreciable decrease in the error and were 
eliminated. This is probably because of the relatively 
small screen size on the 12-hour latitude bias and was 
suspected because of small amount of variance explained. 
Also eliminated were the longitude bias correction equa- 
tions when no history was present. In any case forecasts 
in the absence of history are entirely a climatological 


average. 
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The third modification made to the forecast technique 
concerned the weighting factors. The program was run with 
no weights, just weights on one component (latitude or 
longitude), and combinations with only one of the two 
weighting factors in the multiple. In the final analysis 
the latitude weighting factor was eliminated. .Here again 
it was felt that the relatively small latitudinal screen 
Size made any weight here insignificant. 

To test a possible fourth modification, the forecast 
technique was run again on the set of internally wee eed 
test positions in order to examine the practicality of 
dropping that portion of the history file prior to 1965. 
In this trial the cyclones occurring prior to 1965 were 
excluded as possible analog candidates (though they were 
utilized as test positions). The results indicated no 
appreciable change in accuracy and a sharp decrease in the 
percentage of forecasts made (due to decreased analog 
population). In view of these results, it was decided to 
keep the history file intact. 

The final modification was to correct a problem which 
sometimes results from permitting those analog points with 
no history (first point on an analog track) to be con- 
sidered when points with history are available. In the 
absence of analog history, past relative motion cannot be 
computed; therefore, two screens are inactive, and a dis- 
proportionately large number of no-history points may enter 


the "good-enough" fold. This is particularly troublesome 
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when the past motion of the current cyclone is climatologi- 
cally unusual and proportionally few analogs are permitted 
through the relative motion screens. In these cases an 
abnormally high percentage of analogs making up the con- 
posite are "no-history"™ cases. Hence, the forecast is 
climatology dominated, in a situation where recent motion 
has not followed climatology. To cure this problem, a 
check is made to see if the number of no-history cases ex- 
ceeds that upper limit of the proportion of the total 
expected by chance alone only five percent of the time. 

In these cases, all "no history" analogs are excluded from 
the forecast. This modification increased the number of 
occurrences of failure to make a valid forecast, but it 


did significantly improve a group of poor forecasts. 


F. ANALOG FORECAST FORMAT 

The forecasts from this technique are output as a 
center position and extreme points on the minor and major 
axes of a 50 percent probability ellipse. Both TYFOON 72 
(Jarrell and Wagoner, 1973) and HURRAN (Hope and Neumann, 
1970) use probability ellipses. 

The probability ellipses of the distribution of a 
bivariate normal (Gaussian) population are given by the 


following equation: 


~ -x ~y =" 2 2 
—-5 (ENG ~2r, (eee) (2) = k 
l-r S y Ss Ss Ss 
xy x x y y 
CZ) 
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where x and y are the two random variables and can re- 
present orthogonal components of a forecast error vector; 
x and y are the sample means; 5 and oe are the sample 


standard deviation; and, ey is the sample correlation 
2 
coefficient. The constant, k , has a chi square (x7) 


distribution with two degrees of freedom and the values of 
ve are tabulated for any desired level of probability. The 


geometric center of the ellipse is the point x, y , 


(United States Naval Weather Research Facility, 1963). 
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V. RESULTS AND CONCLUSIONS 


A. RESULTS 

The final forecast technique, henceforth referred to 
as NPEHAT (Northeast Pacific Hurricane Analog Tracker), 
was subject to two types of testing. First, a group of 
simulated forecasts were made for comparative purposes, 
The verification results of these tests are given in 
Table V. NEPHAT forecasts were made for 24, 48, 72, and 
96 hours under four classes of simulated initial position 
errors (see Chapter III). The following results are 
apparent. First, the average error is heavily dependent 
upon the validity of the initial position. Second, the 
forecast technique appeared to give highly satisfactoty 
forecasts, especially when the initial position is based 
on a relatively recent fix. 

In order to further investigate the validity of the 
above results, the 1973 best track data were removed from 
the history file and the forecast technique was run on 
1973 operational positions for which official and MOHATT 
forecasts existed. The homogeneous test set consisted of 
warning positions for nine named tropical cyclones and two 
tropical depressions. All operational (warning) positions 
were ones for which at least a 24-hour forecast could be 


verified. 
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The results, on a cyclone by cyclone basis and strati- 
fied according to synoptic time and forecast interval, 
are contained in Table VI. Two particular cases are worthy 
of discussion at this point. 

Hurricane Doreen was a relatively long-running cyclone 
(16 days) and possessed a zonally oriented track. (Figure 
8). The cyclone was fairly typical of the climatology in 
EASTROPAC with the possible exception of a generally south- 
westward motion during the period 26 through 29 July. The 
average forecast errors are also contained in Table IV and 
include forecasts from all four synoptic times. It should 
be noted that at 24, 48, and 72 hours, the average forecast 
errors for Doreen are less than the average predicted from 
the simulated cases (Table V) with the ieast initial 
position error. Most of the reconnaissance fixes taken 
on Hurricane Doreen were near 1800 GMT, thus forecasts 
made from near this time tended to exhibit increased 
accuracy. 

The other significant case considered Tropical Storm 
Jennifer. This was a relatively short-lived cyclone (four 
days) occurring near the end of September. The recurvature 
track (Figure 9) is considered atypical of EASTROPAC 
cyclones (though it did occur during the period of peak 
recurvature frequency). Jennifer formed near 13.2N, 113.6W 
and moved in a northeasterly manner during the entire period, 


accelerating during the last two days. There were neither 
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aircraft fixes nor good satellite fixes during the entire 
lifespan of this storm. Two items stand out as signifi- 
cant with respect to NEPHAT's performance on this cyclone- 
First, due to the size of the history file relatively few 
analogs were located, thus no NEPHAT forecasts were 
possible at many synoptic times. Secondly, the relatively 
large average forecast errors for this storm were probably 
attributable to both the atypical movement and the absence 
of fixes. This latter conclusion is best demonstrated by 
considering the 1200 GMT forecasts on 23 September. The 
warning position was 13.3N, 116.5W with a 12-hour past 
movement of 0.1 degree north and 2.9 degrees west. This is 
compared with the best-track position at 1200 GMT on 23 
September of 13.3N, 113.4W with a 12-hour movement of O.1 
degree north and 0.2 degrees east. This pseudo westward 
movement was 2eecee accepted by NEPHAT and 24, 48, and 

72 hour forecasts based on 197, 92, and 81 analog positions, 
respectively, were made. The errors for this set of fore- 
casts were: 472 nmi at 24 hours, 877 nmi at 48 hours, and 
1,156 nmi at 72 hours, thus reinforcing the importance 

and necessity of a fairly reliable fix for accurate NEPHAT 
results. 

Table VII details ‘the average forecast error by cyclone 
Stage and forecast interval. These results suggest that 
NPEHAT performs best on the more intense tropical cyclones 
although the techique was developed without regard to cy- 


clone stage and tacitly intended for all stages. 
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A comparison of forecast technique errors before and 
after recurvature (Table VII) shows that NEPHAT errors were 
significantly less (nearly half) for tracks prior to recur- 
vature. This results from a greatly increased zonal error 
component in the after-recurvature cases. The increase is 
rg icaactipity: due to the small historical frequency of eastward 
moving cyclones in EASTROPAC and reflects the domination 
of that small stratification by the errors associated with 
Tropical Storm Jennifer. 

The next step in the verification phase of the technique 
was comparison of NEPHAT forecast errors with the only other 
technique presently used in the EASTROPAC area, MOHATT 
(Renard et al, 1973) and the official forecast (subjective). 
The NEPHAT crrors were compared with the MOHATT forecasts 
(based both on 850-mb and 700-mb steering). These results 
are contained in Tables VIII and IX, respectively. [It 
appears that the NEPHAT forecast errors are significantly 
less than either of the MOHATT modes at all forecast inter- 
vals and all synoptic times. However, the MOHATT (700 mb) 
technique did approach NEPHAT at 24 and 72 hours for the 
synoptic verification time of 0000 GMT. The greatest 
difference in average errors, NEPHAT vs MOHATT, occurred 
at the 1800 GMT synoptic verification time. Since this is 
near the average fix time in EASTROPAC this would give the 
NEPHAT technique its best results, while the nature of 
the MOHATT scheme makes this verification time predictably 


its poorest. 
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Upon comparison with the official forecast errors for 
these same 1973 cases one finds that the errors from the 
NEPHAT technique are less (Table X). There is one excep- 
tion, namely for 24-hour forecast verifying at 0600 GMT, 
at which time the official forecast out-performed the NEPHAT 
technique. At all other synoptic times and forecast inter- 
vals the NEPHAT technique errors were slightly less than 
the official errors. Unlike the MOHATT technique, the 
greatest error difference occurred for a synoptic time 


of 1200 GMT. 


B. CONCLUSIONS 

Based on these results it was concluded that the NEPHAT 
technique has the potential for a valuable aid in fore- 
casting the movement of EASTROPAC tropical cyclones. 

Since most reconnaissance fixes are made at about 1800 
GMT, we assumed that 1800 GMT corresponds to that "time 
Since fix" nearest to three hours and subsequent synoptic 
times 0000, 0600 and 1200 GMT correspond to “time since 
last fix" nearest to 9, 15 and 21 hours, respectively in 
Table V. With this assumption, the simulated results of 
Table V can be directly related to the operational test 
results of Table VIII, IX, or X. Such a comparison is made 
in Table XI. The similarity in average errors of fore- 
casts from simulated test positions and actual operational 
positions infer that the technique outlined in Chapter III 


for generating simulated positions and the usage of those 
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positions in the program development was realistic. Such 
Similarity also tends to confirm that the usage of the 
"Monte Carlo" type simulation realistically modeled the 


operational uncertainty in positioning. 
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APPENDIX A 


The predictors used in the regression analysis described 
in Chapter IV were constructed by multiplying each of the 
items contained in List 1 by each of those items appearing 


ifiewiist 2. 


Piet 1. 

1. Latitude difference at points of origin (TY) 
2. Longitude difference at points of origin (TX) 
3. 12-hr meridional relative motion (BY) 


4. 12-hr zonal relative motion (BX) 


5. Date difference at points of origin (DD) 


Gmrot 2. 
ie 1. O 
2. Latitude of current cyclone (YCO) 
3. - Longitude of current cyclone (XCO) 


4. Julian date of current cyclone (D) 


5. yco- 
6. xco- 
7, D* 
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TABLE I 


Number of eastern tropical North Pacific Ocean cyclones and the average 
number of 0000 or 1200 GMT positions from 1949 through 1973 


AVERAGE NUMBER OF POSITIONS 


YEAR NUMBER OF CYCLONES (0000 OR 1200 GMT) 
1949 6 150 
1950 7 10.5 
1951 9 7.5 
1952 7 6.7 
1953 4 7.0 
1954 12 10.3 
1955 5 7.0 
1956 6.2 
1957 10 12.5 
1958 12 7.6 
1959 13 7.8 
1960 7 9.7 
1961 9 5.2 
1962 9 7.1 
1963 7 5.6 
1964 5 6.4 
1965 10 12.1 
1966 13 12a 
1967 16 13.7 
1968 18 13.1 
1969 12 9.1 
1970 17 11.8 
1971 17 13.9 
1972 12 16.0 
1973 1 13.9 
1949-64 Gil 8.0 
1965-73 14.0 13.0 
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TABLE II 


Mean and variance of EASTROPAC tropical cyclone track eccentricity by 
year. E defined as total eccentricity while R represents across 
track and S is along the track (see Figure 3). 


YEAR CASES’ MEAN(E) VAR. (E) MEAN(R) VAR(R) MEAN (S) VAR. (S) 
) ) 


(NMI) (NMI (NMI)  (NMI2) (NMI) (NMI 
1949 30 19.6 418.1 -0.4 455.9 0.5 344.5 
1950 60 14.4 99.9 -0.3 132.8 -1.2 171.5 
1951 50 255 li 637.8 -5.6 564.8 -0.4 571.8 
1952 33 14.1 69.3 —-2.1 93.61 Oe 169.3 
1953 20 14.5 109.7 -0.4 1255 4.8 bei 2 
1954 100 23.7 222.0 0.7 373.8 -0.1 405.0 
1955 25 20.1 114.4 -2.3 265.7 0.5 247.6 
1956 38 19.1 194.3 2.5 335.9 -2.1 212.8 
1957 105 DT a6 522.9 -3.3 620.8 0.9 651.8 
1958 68 17.9 816.2 -4.3 717.7 -2.9 392.5 
1959 76 lipo 258.3 0.1 22a 0.1 483.6 
1960 54 19.4 185.0 -1.6 264.9 -0.7 295.2 
1961 29 18.9 306.2 -8.3 321.0 0.9 273.9 
1962 46 14.9 206.5 -5.4 246.6 0.9 oe? 
1963 25 32.6 746.1 -0.6 1162.9 -2.5 636.5 
1964 22 16.7 66.1 1s) 267.2 -0.6 75.2 
1965 101 14.8 88.2 -1.9 149.9 0.6 153.1 
1966 131 Pile 209.3 -2.2 245.7 -0.3 413.0 
1967 187 22.4 374.2 -2.2 375.9 -0.3 494.7 
1968 200 19.2 207.4 -0.6 263.2 -0.2 313.9 
1969 85 oe 236.8 -0.6 259 ol 0.1 365.4 
1970 166 15.9 149.5 -1.6 199.4 1 198.0 
1971 202 Pile 2 213.8 -2.3 269.5 -0.1 386.9 
1972 168 Pees B2aar -2.8 218.9 -1.1 595.2 
1973 31. Pie 352.6 0.0 258.6 Oe 537.8 
49-64 781 20.8 362.4 -1.9 TDG -0.3 See 
65-73 1371 20.0 251.5 -1.7 255 el 0.1 392.5 
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TABLE IIl1 


Normalized mean and variance of EASTROPAC tropical cyclone track 
eccentricity by year. E is defined as the total eccentricity (R245 
R represents the across-track difference and S is along the track. Due 
to the normalization process these parameters are dimensionless. 


21/2. 


YEAR CASES MEAN(E) VAR. (E) MEAN(R) VAR. (R) MEAN(S) VAR. (S) 


1949 30 0250 037 = Ug 051 - 006 048 
1950 60 mney) 021 001 024 -.014 032 
1951 50 «337 1.390 pelea 996 -.086 2477 
1952 33 aolyal O12 -.031 018 013 SOzZ 
1953 20 190 ep Se Ws) - 003 020 5B) 028 
1954 100 2230 020 010 037 -.004 041 
1955 25 5 age, -031 -.049 ~065 006 O51 
1956 38 2152 . 006 009 015 -.023 20S 
iby, 105 238 041 -.020 055 O15 042 
1958 68 2158 020 -.023 022 - .009 A878) 
1959 76 - 230 024 -.004 037 000 040 
1960 54 189 7015 =-.009 ize -.004 021 
1961 Zo 224 116 -.109 ~119 O11 034 
1962 46 173 2013 -.049 O17 021 023 
1963 25 20) soo =. 031 086 -.018 049 
1964 Zé 138 004 018 O17 -.011 005 
1965 101 o 159 014 =, 016 022 - 007 sol 
1966 131 e2o2 087 ~.022 046 . 000 045 
1967 187 SoZ .030 -.024 - 036 -.002 5 BN 
1968 200 5 Le 037 . 002 040 001 028 
1969 85 264 120 -.016 066 016 25 
137 @ 166 ~195 elie) -.010 Oo7 042 118 
1971 202 seg D eke) -.025 026 002 .030 
1972 168 2224 034 -.016 022 -.016 062 
1973 131 207 044 -.002 a025 001 062 
49-64 781 wee e117 5 ZS) ~102 -.005 a loi 
65=/3 1371 ~204 048 -.0238 035 003 055 
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TABLE V 


The results of the NEPHAT forecast technique on the 
randomly selected test cases incorporating a simulated 


initial position error. 


TIME SINCE 
LAST FIX 


3 hours 


9 hours 


15 hours 


21 hours 


FORECAST 
INTERVAL 
(HOURS) 

24 

48 

72 

96 


24 
48 
TZ 
96 


24 
48 
72 
96 


24 
48 
72 
96 


FORECASTS MADE 
(4) of POSS. 


NO. 


521 
405 
309 
ads) 


516 
397 
307 
217 


alt 
396 
298 
Za? 


495 
378 
286 
204 
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96 
96 
94 
93 


95 
94 
93 
92 


94 
93 
91 
90 


93 
89 
87 
86 


AVERAGE 


ERROR 
(NMI) 

oie 
171.6 
247.0 
316.5 


106.8 
180.9 
254.6 
324.8 


128.4 
202.0 
265.0 
333.0 


148.8 
2228 
274.5 
345.7 


RMS 
ERROR 
(NMI ) 
108 * 0 
20223 
289.0 
365.3 


124.8 
215... 
297.4 
376.1 


149.6 
Pee 
52.5 
387.0 


174.1 
264.0 
324.0 
403.0 





TABLE VI 


1973 NEPHAT forecast results by storm and forecast interval. Opera-~ 
tional position data were used to initiate forecasts. The number of 
forecasts is contained in parentheses. 


CYCLONE AVERAGE ERROR (NMI) 

24~HOUR 48-HOUR 7 2-HOUR 
AVA 124.9 (25) 23 29023) 923175021) 
CLAUDIA 204.2 ( 7) 30721 (3) 
DOREEN 87.4 (46) 165.5 (42) 237.0 (38) 
TD-5 42.5 (€ 5) 
EMILY 85.7 (23) 134.4 (19) 145.7 (15) 
FLORENCE 78.0 (15) 98.4 (11) 13342 (7) 
GLENDA 107.6 (15) 147.1 (ia 151.8 (¢ 8) 
TD-~10 145.5 ( 6) 
IRAH 111.4 (12) 230.5 ¢€ 8) 327.6 ( 4) 
JENNIFER 346.6 ( 6) 672.6 (¢ 4) 1156.3 ( 1) 
KATHERINE 100.1 (30) 235.0 (25) 394.3 (23) 
LILLIAN OF le 13) 169.6 (10) 197.0 (¢ 6) 
TOTAL 110.2199) 195.8 (156) 267.0 (123) 
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TABLE VII 


NEPHAT 1973 forecast results by stage and forecast interval and relative 


to recurvature,. 


casts. 
STAGE 
TROPICAL 


DEPRESSION 


TROPICAL 
STORM 


HURRICANE 


BEFORE 
RECURVATURE 


AFTER 
RECURVATURE 


24—-HOUR 


143.2 (34) 


1292079) 


79.9 (86) 


OZ CLG) 


263.1 (10) 


AVERAGE ERROR (NMI) 
48-HOUR 
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246.3 (22) 


211.6 (61) 


167.4 (73) 


181.2 (148) 


466.6 ( 8) 


Operational position data were used to initiate fore- 
The number of forecasts is contained in parentheses. 


72-HOUR 


252.8 (14) 


285.4 (57) 


Zac Go 2) 


250 Selo) 


518.2 (¢ 4) 
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Figure 1. Flow diagram of eastern tropical North Pacific analog 
forecast technique. 
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Figure 3. Diagram of vectors used in computing eccentricity of tracks. 
The 24-hour track is ABC. R represents across-track component; S repre- 
sents along-track component and E is the total eccentricity (deviation 
from linear) of the track. 
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Figure 4. Flow diagram of eastern tropical North Pacific cyclone 
analog forecast program development. 
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